INFORMATION EXTRACTION FROM DOCUMENTS WITH REGULAR 



EXPRESSION MATCHING 



Field of the Invention 

The present invention relates to data processing techniques and, more particularly, 
to techniques for providing automatic information extraction from data streams such as 
text and spoken documents. 

Background of the Invention 

There are many situations in which it is desirable to extract key pieces of 
information from documents. For example, in transcribed voice mail messages, the name 
of the caller and any return numbers that were left are crucial for summarizing the call. 
Or when resumes are submitted to a company along with a cover letter, it is desirable to 
extract the job objective and salary requirements of the applicant, in order to determine if 
a suitable match exists. This invention comprises a simple, efficient, and effective way of 
extracting such information. 

In the past, several techniques have been developed to solve the somewhat 
simpler problem of "named entity extraction." In this task, the goal is to identify all 
occurrences of certain classes of words in a document. For example, all the 
person-names, city-names, dates, and times might be identified. One way of identifying 
such entities is to train a statistical classification system to tag each word in the document 
as either a "person-name," "city-name," "date," "time," or "other" word. Examples of 
this sort of approach are disclosed in, e.g., Ratnaprkhi, "A Maximum Entropy Part of 
Speech Tagger," Conference on Empirical Methods in Natural Language Processing, 
University of Pennsylvania, 1996; and Brill, "Transformation-Based Error-Driven 
Learning and Natural Language Processing: A Case Study in Part of Speech Tagging," 
Computational Linguistics, December 1995, the disclosures of which are incorporated by 
reference herein. While the problem of extracting key pieces of information can also be 
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viewed as a tagging problem, in which each word is tagged as either "key information" or 
"irrelevant," such a tagging approach fails to explicitly identify the portions of text that 
are important. 

Thus, there is a need for data processing techniques which explicitly identify 
portions of data that are sought to be identified, rather than only implicitly identifying, or 
tagging, such portions of data. 

Summary of the Invention 

The present invention provides techniques for exploiting the readily-identifiable 
structure of language to explicitly identify portions of data in a document that a user 
seeks to be identified, e.g., relevant or important information. It is to be understood that 
the term "document," as used herein in accordance with the invention, is intended to 
broadly refer to a sequence of symbols (e.g., letters, numbers, characters, etc.), such as a 
data stream representative of text and/or spoken messages. However, it is to be 
understood that the invention applies to many input forms other than typed text or spoken 
messages. By way of further example only, the invention may also be applied to 
information extraction from data streams representing DNA (deoxyribonucleic acid) 
sequences, RNA (ribonucleic acid) sequences, amino-acid sequences, and audio and 
video sequences that are preprocessed into a discrete symbolic form. 

More specifically, the present invention realizes that, in common linguistic usage, 
people typically convey information in highly stereotyped ways. So, for example, in a 
phone call, the caller is likely to identify himself in one of just a few ways, e.g., "Hi 
<recipient-name>, it's <caller-name>" (e.g., "Hi John, it's Bob") or "<recipient-name>, 
<caller-name> here" (e.g., "John, Bob here"). Or in a cover letter, a job applicant is 
likely to express his interest with a phrase like "I am looking for a job in <field>" (e.g., "I 
am looking for a job in electrical engineering"). 

In accordance with this realization, the present invention provides techniques for 
enumerating regularly identifiable or stereotypical phrases that people commonly use to 
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convey particular information, and where exactly in these phrases the particular 
information is to be found. In one embodiment, such phrases are referred to as "regular 
expressions." Using such enumerated phrases, the invention is able to automatically 
identify them in an input data stream and then identify and extract the particular 
information associated with the phrase that is being sought, e.g., important or relevant 
information. 

This approach has several advantages over the previously mentioned tagging 
approach. First, the phrases are readily expressible as regular expressions, and this allows 
them to be stored in one of several common programming languages, e.g., as a "flex" or 
"perl" program. Both these languages have built-in support for regular expressions. 
Secondly, the use of regular-expression technology enables extremely fast pattern 
matching and information extraction with highly optimized standard programs. Thirdly, 
the phrases can be identified without the expensive and time consuming step of gathering 
and annotating a large "training" database. Finally, if desired, the technique can be 
combined with statistical based procedures, e.g., by using the phrases as features in a 
statistical system, or by using a statistical procedure to automatically collect a large pool 
of candidate phrases which can then be selected for inclusion by a human. 

One skilled in the art will realize various applications for the invention. By way 
of example only, such enumerated phrases may be automatically identified in a 
transcribed voice mail message, and the important information in the message, e.g., a 
phone number or caller's name, may be automatically extracted and presented to the user 
or stored for subsequent use. 

These and other objects, features and advantages of the present invention will 
become apparent from the following detailed description of illustrative embodiments 
thereof, which is to be read in connection with the accompanying drawings. 
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Brief Description of the Drawing s 

FIG. 1 is a flow diagram illustrating an information extraction methodology 
according to an embodiment of the present invention; and 

FIG. 2 is a block diagram illustrating a generalized hardware architecture of a data 
5 processing system suitable for implementing an information extraction methodology 

according to the present invention. 
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Detailed Description of Preferred Embodiments 

As will be explained in detail below, the present invention provides techniques for 
using stereotypical phrases or "regular expressions" to identify the information-bearing 
^ 10 portions of a document, and thereby explicitly identity the information found therein. 

fn Regular expressions, as have been discussed in Aho et al., "Compilers: Principles, 

y Techniques, and Tools," Addison- Wesley, 1985, the disclosure of which is incorporated 

•S by reference herein, comprise symbolic strings, typically word sequences, that can be 

p constructed by the basic operations of "and" and "or" acting on an atomic alphabet of 

15 symbols. So, for example, the pattern "the dog" produces a match only when, in the data 

being considered, the symbol "the" is followed by the symbol "dog." This represents the 
operation of concatenation or "and." The pattern "the (dog | cat)" illustrates the "or" 
operation, i.e., the pattern matches either the string "the dog" or "the cat." The operation 
of "classing" is also possible. So, for example, a "pet" class may be defined as either 
20 "dog" or "cat:" 

<animal> ::= (dog | cat) 

Then, subsequent regular expressions can make use of this class, for example, the 
pattern: "the <pet>." A wide variety of extensions to regular expressions exist, for 
example, restrictions on where in a document a pattern is found, or restrictions on the 
25 length of repeated sequences in a regular expression. In accordance with an illustrative 

embodiment of the invention, the term "regular expression" is taken to mean any form of 
pattern that is matchable in the flex, lex, or perl programming languages, although the 
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invention is not limited thereto. The programming languages flex and lex are described in 
J.R. Levine et al., "Lex & Yacc," 1992, the disclosure of which is incorporated by 
reference herein. The programming language perl is described in L. Wall et al., 
"Programming Perl," 1996, the disclosure of which is incorporated by reference herein. 
Similarly, in accordance with such an illustrative embodiment, the term "matching" refers 
to the processes by which these programs match their input. 

In accordance with an embodiment of the invention, when an information-bearing 
regular expression is matched, an action is taken to present the information in an 
appropriate way. There are two main types of regular expressions that may be used in 
this particular embodiment: trigger prefixes and trigger suffixes. 

A trigger prefix is a characteristic phrase that typically precedes a piece of 
information, for example, in a voice mail message, "give me a call back at" is a trigger 
phrase that precedes a phone number. 

A trigger suffix is a phrase that typically follows a key piece of information, even 
when a trigger prefix is not present. For example, the phrase "talk to you later bye" is 
often a post-facto signal that a phone number has been provided, when the words 
immediately preceding the phrase are a sequence of numbers. 

In this embodiment of the invention, trigger prefixes and suffixes may be used 
either separately, or combined together into larger composite patterns. The operation of 
word classing is also inherent in this embodiment of the invention. For example, a set of 
personal names such as those found in a phone book may be identified a a "person-name" 
class. Subsequently, patterns of the form "Hi, it's <person-name>+" can be matched, and 
the words matching the "person-name" tokens can be displayed as the caller. It is to be 
understoo^fey those skilled in the art that there are numerous ways of combining trigger 
Felixes and suffixes, word classes, and other pattern-matching operations, such as the 
use of multiple states, each with its own set of matchable patterns (as may be done in flex) 
in order to identify and extract information. 



YOR920010253US1 



5 



In addition to being used as a stand-alone method for information extraction, 
regular expressions can be in combination with statistical techniques. For example, the 
existence of a pattern such as "Hi <person-name>, it's <person-name>" can be used as a 
feature in a maximum-entropy word-tagging system. 

Referring now to FIG. 1, a flow diagram illustrates an information extraction 
methodology according to an embodiment of the present invention. As shown in FIG. 1, 
the methodology 10 begins by obtaining the input data 12 to be processed. As mentioned 
above, the input data is a sequence of discrete symbols or a document, such as may be 
representative of text and/or a transcribed spoken message. 

In step 14, the input data is normalized. This process may include standardizing 
any characteristics of the input that are irrelevant to, or a hindrance to, information 
extraction. An example of normalization, for text input, is to change all the letters in the 
text stream to lower-case and to replace multiple blank spaces between words by a single 
blank space. This makes subsequent pattern matching easier. 

By way of example, the following is a sample flex program for normalizing text 

input: 

%{ 

#include <iostream.h> 
#include <ctype.h> 

%} 

%option noyywrap 
%option never-interactive 

ws [\t]+ 

%% 

{cout«"";} 
[!V@,"( )?] {;> 
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\<[ A \>]*\>{ws}* {;} 
{ws} {cout«" ";} 

{cout«char(tolower(*yytext)); } 

%% 

main( ) 
{ 

yylex(); 

} 

In step 16, one or more previously- stored word (or, in general, one or more 
symbols) lists are used to identify and mark occurrences of words that belong to certain 
classes. By way of example, such a class-annotation operation may include marking all 
proper names by prefixing them with an "!" mark. 

By way of example, the following is a sample C++ program for annotating names 
identified in a normalized text stream: 



#include <iostream.h> 
#include <fstream.h> 
#include <stdlib.h> 
#include <set> 
#include <string> 

main() 

{ 

set<string>name; 

ifstream namesin("../data/person_names 1 '); // a text file listing names 
if (Inamesin) 

{ 

cout « "Unable to find ../data/person_names\n"; 
exit(l); 

} 

while (!namesin.eof()) 

{ 

string s; 
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namesin » s » ws; 
name.insert(s); 

namesin.close(); 

while (!cin.eof()) 
{ 

string s; 

cin » s » ws; 

if (name.count(s)) 

cout«"!"«s«" "; 

else 

cout «s« " ,! ; 

} 

} 

In step 18, the normalized and class-annotated text is read by a regular-expression 
matching program, and the information-bearing portions of the text are analyzed and 
extracted. In a preferred embodiment, the regular expressions are specified in and 
matched by a specialized regular expression matching program, such as may be 
implemented in flex. In this process, it is understood that all the mechanisms available in 
such a programming language may be used. These include the use of special start states, 
backtracking, context-sensitive matching, and embedded special-purpose "C" code. 

Specifically, the matching operation in step 18 takes the normalized, 
class-annotated input data and identifies the regular expressions in the data by comparing 
the data to previously-stored regular expressions. These previously-stored regular 
expressions may include, for example, trigger prefixes, trigger suffixes, word classes, and 
other matchable patterns. When a match occurs, the structure of the regular expression is 
analyzed to identify the information-bearing portion of the expression. The information 
is then extracted from the expression. 

By way of example, the following is a sample flex program for identifying caller 
names and phone numbers in a transcribed voice mail messages. As is evident, the 
program enumerates a plurality of regular expressions, categorized as 
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PHONE_NUMBER_STATE, NAMESTATE, EXTENDED_NAME_STATE, and 
TERMINATION STATE, that are considered during the matching step 18: 



%{ 

#include <iostream.h> 
5 . #include <string.h> 

const char *number_type; 

const char *tl = "tieline"; 

const char *extension = "extension"; 
m const char *pager = pager"; 

; 5 4 10 const char * fax = "fax number"; 

m const char *none = ""; 

* !'"S 

(5 char number_buff[ 1 0000] ; 

m 

m %} 

^ %option noyywrap 

15 %opti on never-interactive 

\"f. I* many patterns like IN-GENERIC_NAME-AT-DIGIT+unaccounted for */ 

m spelleddigit 

((zero | oh | one | two | three | four | five | six | seven | eight | nine | hundred | thousand | ten | 
eleven | twelve | thirteen | fourteen | fifteen | sixteen | seventeen | eighteen | nineteen | twenty | 
20 thirty | forty | fifty | sixty | seventy | eighty | ninety | hundred)[ ]?) 

numeric_digit ((1 1 2 1 3 1 4 1 5 1 6 1 7 1 8 1 9 1 10)[ ]?) 
digit ([ ]?{spelled_digit} | [ ]?{numeric_digit}) 

phone number ((country[ ]code[ ] {digit} {2,})?(toll[ ]free)?(area[ ] | area[ ]code[ 
])?{digit} {2,} ((or[ ] | that's [ ] | sorry[ ]) | {digit} {2,})?(option[ ] {digit} +)?(extension[ 
25 ]{digit}{2,})?)tie_line([]?(tie[]line|tieline)([]number)?) 
name ![a-z']+ 

%x PHONE NUMBER S TATE 
%x NAME_STATE 
%x EXTENDED_NAME_STATE 
30 %x TERMINATION_STATE 
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%% 

(1 1 2 1 3 1 4 1 5 1 6 1 7 1 8 1 9 1 0)+ " :" {cout « yytext « endl; /* get header */} 

{digit} ({digit} | "extension") {3,} {strcpy(number_buff, yytext); BEGIN 
TERMINATIONS! ATE; } 

<TERMINATION_STATE>"thank you" | 
<TERMINATION_STATE>"thanks" | 
<TERMINATION_STATE>"take care" | 
<TERMINATION_STATE>"bye" | 
<TERMINATION_STATE>"talk to you" | 
<TERMINATION_STATE>"okay bye" | 

<TERMINATION_STATE>"have a "(good | great)" day" {cout « "Number: " 
«number_buff«endl; BEGIN INITIAL;} 

<TERMINATION_STATE>«EOF» {cout « "Number: "number_buff « endl; 
BEGIN INITIAL;} 

<TERMINATION_STATE>.{unput(*yytext); BEGIN INITIAL;} 

"on extension" | 
"at extension" | 
"extension" | 

"extension is" {numberjype = extension; BEGIN PHONE NUMBER ST ATE; } 

"my "{tiejine} "is" | 
"my "{tiejine}" here is" | 
{tiejine} "is" | 

" {tie_line} " " {numberjype = tl; BEGIN PHONE NUMBER STATE; } 

"again is" | 

"again" | 

"back" | 

"call me" | 

"call me at" | 

"call me back at" | 

"callme"[a-zA-Z]+/'at"| 

"call me back on" | 

"call me on" | 

"call back at" | 

"call back on" | 

"give me a buzz" | 



YOR920010253US1 



10 



"give me buzz at" | 

"give me a holler" | 

"give me a holler at" | 

"give me a ring' 1 1 
5 "give me a call" | 

"give me a ring at" | 

"give me a call at" | 

"give me a call at home" | 

"give me a call at work" | 
10 "give me a call at your convenience" | 

"give me a call back at" | 

"give me a call back on" | 

"give me a call back with that information at" | 
Q "give me a call if you get a chance" | 

^ 1 5 "give me a call please" | 

"give me a call please at" | 
^ "give me a call when you get a chance" | 

njj "give me a call when you can" | 

rf$ "give me a call when you can please" | 

C? 20 "give us a call" | 

^ "give us a call at" | 

Q "here" | 

fl i can be reached at" | 
J^J "i am at" | 

S 25 "i ? mat"| 

U " ifU be at " I 

"i ? m on" | 

"leave me a message" | 

"leave me a message at" | 
30 "my number is" | 

"my number here is" | 

"my number here in "(!?[a-z]+[ ])"is" | 

"my number's" | 

"my phone number's" | 
35 "number again is" | 

"number at home is" | 

"number at work is" | 

"number here is" | 

"number is" | 
40 "number's" | 
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"outside line" | 
"outside" | 
"please call" | 
"phone" | 

"please return our call at" | 
"reach met at" | 
"returning your call" | 
"talk to you later" | 
"try me at" | 

"try me at this number" | 
"you could reach us at" | 
"when you have a chance" | 

"when you get a chance" {number_type=none; BEGIN PHONE_NUMBER_STATE; } 
"fax number is" | 

"my fax number's {number_type=fax; BEGIN PHONE_NUMBER_ST ATE;} 

"my pager" | 

"my pager is" | 

"give me a page" | 

"give me a page at" | 

"page me at" | 

"page me" | 

"page number" {number_type=pager; BEGIN 

PHONE_NUMBER_STATE;} 

<PHONE_NUMBER_ST ATE> {phone_number} {cout « "Number: " « numberjype 
« yytext « endl; BEGIN INTIAL;} 

<PHONE_NUMBER_STATE>. {unput(*yytext); BEGIN INITIAL;} 
"it's " {phone_number} | 

"on " {phone_number} {char *c=strchr(yytext, ' '); C++; cout « "Number: " « c « 
endl;} 

"it's me" | 

"it's just me" {cout « "Name: me" « endl;} 

"this is your wife" {cout « "Name: wife" « endl;} 

"this is receiving" {cout « "Name: receiving" « endl;} 

"this is the mail room" {cout « "Name: the mail room" « endl;} 

A ({name}[ ]){2,3} {cout « "Name: " « (strchr(yytext, ' f )+l) « endl;} 

("hi" | "hey" | "hello") {name}" "{name}" "({name}" ")? {char *c=strchr(yytext, ' '); 
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c=strchr(c+l, ' '); cout « "Name: " « (c+1) « endl;} 

"good morning " {name}" " | 

"yeah" {name}" "| 

({name}[])? "this is" | 

{name} "it's" | 

{name} "hi" | 

"hi i'm" | 

"my name is" | 

"my name's" | 

"the name is" 

"the name's" | 

"hey"({name}[ ])? "this"("is")? | 

"hi"({name}[])? "this"("is")? | 

({name}[])? "hi it's" | 

({name}[])? "hey it's" | 

( {name} [ ])? "how you doing it's" | 

{name}"this" {BEGIN NAME_STATE;} 

<NAME_STATE>({name}[ ])+ {cout « "Name: " « yytext « endl; 

number_type=none; 

BEGIN PHONENUMBERST ATE; } 

<NAME_STATE>("me" | "mom" | "your sis" | "your sister" | "your wife" | "your brother" 
"your father" | "your husband") {cout « "Name: " « yytext « endl; BEGIN 
INITIAL;} 

<NAME_STATE>( {name} [ ])+"from" | 
<NAME_STATE>( {name} [ ])+"calling from" | 
<NAME_STATE>( {name} [ ])+"i'm calling from" | 
<NAME_STATE>( {name} [ ])+"with" | 
<NAME_STATE>({name}[ ])+"i'm with" | 
<NAME_STATE>( {name} [ ])+"at" | 
<NAME_ST ATE>( {name} [ ])+"over at" | 
<NAME_STATE>( {name} [ ])+"down at" | 
<NAME_STATE>( {name} [ ])+"over in" | 
<NAME_STATE>( {name} [ ])+"up in" | 
<NAME_ST ATE>( {name} [ ])+"down in" | 
<NAME_ST ATE>( {name} [ ])+"up on" | 
<NAME_ST ATE>( {name} [ ])+"down on" | 
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<NAME_STATE>({name}[ ])+"in" {cout « "Name: " « yytext; BEGIN 

EXTENDED_NAME_STATE; } 

<NAME_STATE>. {unput(* yytext); BEGIN INITIAL;} 

<EXTENDED_NAME_STATE>"i'm" | 
5 <EXTENDED_NAME_STATE>"i" | 

<EXTENDED_NAME_STATE>"i've" | 
<EXTENDED_NAME_STATE>"i'd" | 
<EXTENDED_NAME_STATE>"my" | 
<EXTENDED_NAME_STATE>"it's" | 
10 <EXTENDED_NAME_STATE>"it is" | 

<EXTENDED_NAME_STATE>"we" | 
<EXTENDED_NAME_STATE>"when" | 
<EXTENDED_NAME_STATE>"you" | 
<EXTENDED_NAME_STATE>"calling" | 



15 <EXTENDED_NAME_STATE>"now" | 

fi <EXTENDED NAME STATE>"a" I 



Iti 



<EXTENDED_NAME_STATE>"if | 
^ <EXTENDED_NAME_STATE>"give" | 

<EXTENDED_NAME_STATE>"their" | 
20 <EXTENDED_N AME_ST ATE>" and" | 

<EXTENDED_NAME_STATE>"notifying"| 
<EXTENDED_NAME_STATE>"returning" | 
<EXTENDED_NAME_STATE>"sorry" | 
<EXTENDED_NAME_STATE>"can" | 
25 <EXTENDED_NAME_STATE>"got" | 

<EXTENDED_NAME_STATE>"earlier" | 
<EXTENDED_NAME_STATE>"your" | 
<EXTENDED_NAME_STATE>"just" | 
<EXTENDED_NAME_STATE>"that" | 
30 <EXTENDED_NAME_STATE>"could" | 

<EXTENDED_NAME_STATE>"would" | 
<EXTENDED_NAME_STATE>"before" | 
<EXTENDED_NAME_STATE>"thanks" | 
<EXTENDED_NAME_STATE>"thank" | 
35 <EXTENDED_NAME_STATE>"wanted" | 

<EXTENDED_NAME_STATE>"following" | 
<EXTENDED_NAME_STATE>"regarding" | 
<EXTENDED_NAME_STATE>"may" | 
<EXTENDED_NAME_STATE>"let" | 
40 <EXTENDED NAME STATE>"he" I 
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<EXTENDED_NAME_ST ATE>" about" | 
<EXTENDED_NAME_ST ATE>" again" | 
<EXTENDED_NAME_STATE>"wanting" | 
<EXTENDED_NAME_STATE>"appreciate" | 
<EXTENDED_NAME_STATE>"was" | 
<EXTENDED_NAME_STATE>"we're" | 
<EXTENDED_NAME_STATE>"or" | 
<EXTENDED_NAME_STATE>"you've" | 
<EXTENDED_NAME_STATE>" right" | 
<EXTENDED_N AME_ST ATE>" first" | 
<EXTENDED_NAME_STATE>[ ]?"tieline" | 
<EXTENDED_NAME_STATE>[ ]?"extension" | 
<EXTENDED_NAME_STATE>" " {digit} | 

<EXTENDED_NAME_STATE>"please" {cout « endl; char *q=yytext+strlen(yytext); 
while (q>yytext) unput(*~q); number_type=none; BEGIN 
PHONENUMBERJS TATE; } 
<EXTENDED_NAME_STATE>. {ECHO;} 

•{;} 

%% 

mainO 
{ 

yylexO; 
cout « endl; 

} 

Thus, by way of example, if the voice message input to the methodology 10 
contains the phrase "call me back at 555-1234," the above program determines that the 
phrase "call me back at" matches one of the enumerated expressions. Then, the 
information associated with the phrase "call me back at," namely, "555-1234," is 
identified as the information-bearing portion of the expression, and extracted. 

The extracted output data 20 may then be presented to a user. For example, this 
may include displaying the information to the user on a display or converting the 
information to audio and audibly presenting the information to the user in accordance 
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with an output speaker. The extracted data may also be used to take some other specified 
action, e.g., place extracted data in an electronic phone book, notify user of a message 
from a particularly important person, notify a user of a message on a particular topic, etc. 

Referring now to FIG. 2, a block diagram illustrates a generalized hardware 
architecture of a data processing system suitable for implementing an information 
extraction methodology according to the present invention. As shown, the system 30 
includes a data capture device 32, a data signal processor 34, a data output device 36, and 
memory 38. 

The data capture device 32 generally obtains the data stream that is to be 
processed by the system 30. The device's specific structure and operations depend on the 
application in which the system is employed. For example, in a voice mail application, 
the data capture device may be a speech processing device capable of taking an audio 
stream recorded in accordance with a voice mail system and converting or transcribing 
the audio stream to a discrete data or symbol sequence. The device may, for example, 
utilize conventional speech recognition techniques or some other known transcription 
techniques. In a text based application, the device may be a digital scanner capable of 
converting a text document into a discrete data or symbol sequence. The device may, for 
example, utilize conventional optical character recognition techniques. Of course, 
depending on the data type, the data capture device may take on alternate forms. 

The data signal processor 34 generally performs and/or controls the operations of 
the methodologies of the present invention, in conjunction with the memory 38. That is, 
the signal processor performs and/or controls the steps depicted in the flow diagram of 
FIG. 1. 

It is to be appreciated that the term "processor" as used herein is intended to 
include any processing device, such as, for example, one that includes a CPU (central 
processing unit) or other processing circuitry. For example, the processor may be a 
digital signal processor, as is known in the art. Also the term "processor" may refer to 
one or more individual processors. The term "memory" as used herein is intended to 
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include any memory devices associated with a processor or CPU, such as, for example, 
RAM, ROM, a fixed memory device (e.g., hard drive), a removable memory device (e.g., 
diskette), flash memory, etc. It is to be understood that the previously-generated word 
classes and regular expressions used in the class-annotation and expression matching 
operations, described above in accordance with the invention, may be stored in memory 
38 and accessed when required. 

Accordingly, one or more computer software programs including instructions or 
code for performing the methodologies of the invention, as described herein, may be 
stored in one or more of the associated memory devices (e.g., ROM, fixed or removable 
memory) and, when ready to be utilized, loaded in part or in whole (e.g., into RAM) and 
executed by a CPU. 

The data output device 36 generally presents the data extracted from the input 
data stream to a user. Again, the device's specific structure and operations depend on the 
application in which the system is employed. For example, in a voice mail application, 
the data capture device may be an audio output system capable of taking the extracted 
discrete data and converting the data to a form to be audibly output to the user. The 
device may, for example, utilize conventional text-to-speech or other speech synthesis 
techniques. Such techniques may also be used in a text based application. Alternatively, 
the device may be a display for visually presenting the extracted data to the user. Of 
course, depending on the data type, the data output device may take on alternate forms. 

It is to be understood that the elements illustrated in the figures may be 
implemented in various forms of hardware, software, or combinations thereof, e.g., one or 
more digital signal processors with associated memory, application specific integrated 
circuit(s), functional circuitry, one or more appropriately programmed general purpose 
digital computers with associated memory, etc. For example, the information extraction 
methodologies of the invention may be implemented in various personal computing 
devices. Given the teachings of the invention provided herein, one of ordinary skill in the 
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related art will be able to contemplate other implementations of the elements of the 
invention. 

Although illustrative embodiments of the present invention have been described 
herein with reference to the accompanying drawings, it is to be understood that the 
invention is not limited to those precise embodiments, and that various other changes and 
modifications may be effected therein by one skilled in the art without departing from the 
scope or spirit of the invention. 
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